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ABSTRACT: Momentary time sampling, partial-interval recording, and event coding are observational 
coding methods commonly used to examine the social and challenging behaviors of children at risk 
for or with developmental delays or disabilities. Yet there is limited research comparing the accuracy 
of and relationship between these three coding methods. By coding the low-frequency social 
behaviors of 100 preschool-aged children with autism spectrum disorder, the current study examines 
the associations among the three methodologies. Results indicated a strong relationship among all 
three coding methodologies. The findings provide information to researchers and practitioners 
considering the benefits and drawbacks of each coding methodology. 


■ Various observational coding methods 
have been employed across research studies 
in an effort to assess children's social behavior 
(Odom & Ogawa, 1992). Determining the best 
method of capturing and examining social 
behaviors is of particular interest in research 
involving children with autism spectrum dis¬ 
order (ASD). Children with ASD characteristi¬ 
cally display low incidences of social behav¬ 
iors (American Psychiatric Association, 2000; 
Reszka, Odom, & Hume, 2012), making direct 
assessment of these behaviors a challenge 
(Cunningham, 2012; Tsao et al., 2008). Yet 


these behaviors are important to capture in 
order to best identify ecological features of 
classrooms and interventions that will promote 
the social development of children with ASD 
(Reszka et al., 2012). A variety of coding 
methods have been used to capture low- 
occurring behaviors, such as the social behav¬ 
iors of young children with ASD (Gardenier, 
MacDonald, & Green, 2004; Reszka et al., 
2012; Tsao et al., 2008); however, no study 
has directly compared these coding methods 
in this group of children to determine the 
utility of each. 
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Three commonly used coding methods 
include momentary time sampling (MTS), par¬ 
tial-interval recording (PIR), and event coding. 
Event coding, also called frequency counting, 
is often viewed as the most precise observa¬ 
tional method for assessing the quantity of 
behavior because the observer records each 
instance of the behavior (Suen & Ary, 1989). 
However, due to the intensity of data 
collection, event coding is sometimes diffi¬ 
cult to collect in real time and in field 
settings. PIR and MTS are designed to 
estimate the quantity of behavior that occurs 
and were developed as alternatives to event 
coding because they may be less difficult to 
collect. However, these discontinuous meth¬ 
ods of observational coding only provide 
estimates of behaviors because they do not 
record each behavioral occurrence. MTS 
involves coding a behavior that only occurs 
at a specific point in time during a specified 
time frame (e.g., the observational point in 
time may occur every 10 s, and only 
behaviors that occur at that moment in time 
are coded; Thompson, Symons, & Felce, 
2000). For PIR, in contrast, researchers 
observe for a period of time (e.g., 10 s) and 
record a behavior as having occurred at any 
point during the specified time frame 
(Thompson et al., 2000). 

A variety of factors contribute to decisions 
about the selection of behavior observation 
and recording systems, including the available 
resources, the complexity of the coding 
scheme, and the type of behavior observed. 
Generally, continuous observation and record¬ 
ing is deemed most desirable by researchers 
(e.g., event coding); however, this method is 
often time- and cost-prohibitive. Researchers 
then must carefully weigh the costs and 
benefits of other sampling methods (PIR, 
MTS) and select the most feasible option, 
perhaps sacrificing perceived accuracy, in¬ 
cluding overestimating or underestimating 
behaviors (Gardenier et al., 2004). This notion 
of reduced or compromised accuracy requires 
further exploration as the accuracy of out¬ 
comes reported in research studies may 
depend heavily on the type of coding meth¬ 
odology utilized. 

In the few studies that have examined the 
relationships between coding methods, the 
results indicated that data analyzed using 
different methodologies are at least moderately 
correlated. One study of primate social behav¬ 
iors found that MTS and event coding were 


moderately correlated (r = 0.55-0.66), and 
event coding and PIR were more strongly 
correlated (r = 0.76-0.96) (Rhine & Linville, 
1980). Rhine and Linville recommended using 
PIR coding rather than MTS because estimates 
of behavior from PIR coding were more closely 
related to the actual duration and frequency of 
behavior occurrence. 

Compared to PIR, MTS may be more 
accurate for observations of the duration of 
behaviors, but both MTS and PIR provide 
inaccurate estimates of behavior rates (Harrop 
& Daniels, 1986). Harrop and Daniels used 
computer-simulated data to compare the 
results of coding the rates and duration of 
behaviors using MTS and PIR methods. Com¬ 
parisons between coding methods often are 
conducted using simulated data (e.g., Harrop, 
Daniels, & Foulkes, 1990; Kearns, Edwards, 
& Tingstrom, 1990; Rapp, Colby-Dirksen, 
Michalski, Carroll, & Lindenberg, 2008). Sim¬ 
ulated data refers to data in which responses are 
generated by a computer rather than by 
observations of humans or other live organisms. 
Harrop and Daniels used an observation 
window of 1 s out of 15 s for MTS and observed 
the behavior for 10-s intervals with a 5-s non¬ 
observation break for PI R over the course of 1 hr. 
The behavior of interest was simulated to occur 
at constant durations (1, 5, 10, and 20 s) with 
expected frequencies ranging from 20 to 120 
behaviors per hour in the "low to medium" rate 
group and 120-720 times per hour in the 
"medium to high" rate group. MTS tended to be 
less sensitive when detecting changes in the 
rates and durations of behaviors, and PIR 
tended to provide estimates with more system¬ 
atic error when estimating relative changes in 
behaviors (Harrop & Daniels, 1986; Powell et 
al., 1975). PIR, in particular, overestimates the 
rates of behavior when behaviors occur at 
lower rates and underestimates when behaviors 
are short in duration and occur at higher rates 
(Harrop & Daniels, 1986). 

Repp, Deitz, Boles, Deitz, and Repp 
(1976) also found that PIR underestimates 
behaviors that occur at higher rates; however, 
they noted that estimates of behaviors at low or 
medium rates were fairly accurate. Using 
simulated data (generated by electromechan¬ 
ical pulses from pens), they simulated rates of 
10 behaviors per minute, 1 per minute, and 0.1 
per minute and then of varying patterns of 
responses (i.e., constant across the session or 
in bursts of varying rates across the session). In 
relation to MTS, they found it to underestimate 
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behavior responses when responses did not 
occur at a consistent rate throughout the entire 
observation as well as when the responses 
were at medium (1 per minute) or high (10 per 
minute) rates and to overestimate behaviors 
that occurred at low rates (Repp et al., 1976). 

In addition, methodologists propose that for 
low-frequency behaviors MTS may underesti¬ 
mate the frequency of events that actually occur, 
which may be better captured using an event 
recording system (Suen & Ary, 1989). Ary and 
Suen (1983) conducted a simulated study to 
compare the accuracy of MTS and PIR with 
respect to the duration and frequency of 
behaviors. They generated data representing 
1800 s (30 min) of observations with frequencies 
ranging from 2 to 12 and durations set at 10-15, 
30-60, and 90-120 s and simulated 100 cases 
for each behavioral situation. They found that for 
shorter observation intervals, the frequency 
measures were perfectly accurate, and the 
estimates of duration using MTS were very 
accurate, with 1%-3% of intervals with errors 
in estimating duration. Generally, shorter inter¬ 
vals of MTS will provide more accurate estimates 
of the durations and frequencies of behaviors, 
but the intervals of observation should be set 
based on how often the behavior of interest is 
expected to occur (Ary & Suen, 1983). 

The studies described above all used 
simulated data. Studies comparing these meth¬ 
ods using actual data collected as part of a 
research study are less common throughout the 
literature, yet this type of study likely has the 
most relevance to inform research and practice. 
It should be noted, however, that observa¬ 
tional coding systems have been used within 
the context of descriptive and intervention 
studies involving children with ASD although 
the purpose of these studies was not to 
compare behavioral observation systems. For 
example, Yoder and Stone (2006) examined 
how two interventions ([a] responsive educa¬ 
tion and prelinguistic milieu teaching [RPMT] 
and [b] picture exchange communication 
system |PECS]) impacted the social behavior 
(i.e., requesting, initiating joint attention, and 
exchanges) of preschool children with autism 
by coding frequency of social behaviors. 
Similarly, frequency data was used to exam¬ 
ine the impact of an enhanced milieu 
teaching intervention to increase social com¬ 
munication skills of preschool children with 
autism (Hancock & Kaiser, 2002). Addition¬ 
ally, Wong and Kasari (2012) used continu¬ 
ous recording in 5-min intervals to determine 


the joint attention and play skills of children 
with autism in preschool classrooms. Partial 
interval recording systems also have been 
employed to examine if an intervention 
targeting social skills increases these skills 
in preschoolers with autism (Conroy, Boyd, 
Asmus, & Madera, 2007). Finally, several 
studies have examined ecological features of 
classrooms and the resulting social behavior 
of preschoolers with disabilities, including 
those with autism, using MTS (Reszka et al., 
2012; Tsao et al., 2008). Using MTS, Reszka 
and colleagues found very low incidences of 
social behaviors during playtime activities in 
preschool classrooms (less than 2%). This 
method may be especially problematic when 
observing the social behaviors of children 
with ASD as it may be more likely than for 
event recording or PIR that social behaviors 
will be missed in the coding process because 
of the low frequency of the behavior. 

Given difficulties with social interactions, 
social skill improvements are often a primary 
target of intervention for children with autism 
(e.g., Hancock & Kaiser, 2002; Wong & Kasari, 
2012; Yoder & Stone, 2006). Due to this, there 
is a need to determine how to best assess, 
observationally, these behaviors to obtain the 
most appropriate, accurate, and reliable data 
while still being sensitive to the time and cost 
restraints of research projects. 

Research Questions 

This study compares the associations 
among the three commonly used behavioral 
observation methods noted previously (event 
coding, MTS, PIR). The specific research 
questions in this study are what are the 
associations among three observational meth¬ 
odologies (event coding, MTS, and PIR) for 
the social behaviors of children with ASD 
directed toward adults and peers, and using 
the three methodologies, are there significant 
differences in social behaviors for children 
with ASD enrolled in treatment and educa¬ 
tion of autistic and related communication- 
handicapped children (TEACCH), Learning 
Experiences: alternative programs for pre¬ 
schoolers and parents (LEAP), and business 
as usual (BAU) classrooms? 

Method 

This analysis was part of a larger study 
comparing the efficacy of school-based, com- 
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prehensive treatment models for preschoolers 
with ASD (Boyd et al., 2014). 

Child Participants 

Participants included 100 preschool-aged 
children (84 males, 13 females) across four 
states (North Carolina, Minnesota, Florida, and 
Colorado). The child participants' mean age 
was 47.3 months (range 36.0-62.0 months). 
Participants' mean age equivalence was ap¬ 
proximately 36 months as determined by the 
Mullen visual reception (VR) subscale (VR is 
often used as a proxy for nonverbal cognitive 
ability). Eighty-five percent of the participants 
were White, 8% were Black, 5% were Asian, 
and 2% were multiracial. Trained research staff 
confirmed diagnosis of ASD with the Autism 
Diagnostic Observation Schedule (ADOS) 
(Lord, Rutter, DiLavore, & Risi, 1999). Each 
child was enrolled in one of two comprehen¬ 
sive treatment model (CTM) programs in a 
public school (LEAP, 33 children, or TEACCH, 
33 children) or in the control condition or BAU 
public school classroom (34 children). The term 
“BAU'' refers to classrooms in which teachers 
do not adhere to one theoretical/conceptual 
framework to guide their instructional practices 
(e.g., applied behavior analysis); rather, teach¬ 
ers in these classrooms use a variety of 
intervention approaches from multiple models. 
This eclectic model is the one typically used 
with children with ASD in public schools 
(Stahmer, Collings, & Palinkas, 2005). From 
the larger sample (n = 198), participants were 
randomly selected until we had obtained 
approximately equal numbers of participants 
per classroom type. 

Classrooms/Teachers 

All teachers and classrooms had to meet 
the following criteria to be included in the 
study: classrooms operated within the public 
school system, teachers licensed to teach in 
their respective states, and lead teacher having 
taught children with ASD for at least 2 years 
prior to inclusion in the study. In addition, 
TEACCH and LEAP teachers must have attend¬ 
ed a formal TEACCH or LEAP training (at least 
at the district level) and have worked in a 
TEACCH or LEAP classroom for at least 2 years 
prior to the study. 

The TEACCH and LEAP CTMs represent 
somewhat contrasting approaches to educat¬ 
ing children with ASD. TEACCH bases its 


conceptual orientation in cognitive-social 
learning theory and subscribes to a "culture 
of autism," in which accommodations such as 
visual schedules and work systems (Hume, 
Plavnick, & Odom, 2012) are made to the 
environment versus the individual to promote 
the child's engagement and learning (Mesibov, 
Shea, & Schopler, 2005). In the context of 
schools, this has often manifested itself in 
children with ASD being educated together in 
classrooms that are separate from the chil¬ 
dren's typically developing peers. In contrast, 
LEAP bases its treatment approach on a blend 
of applied behavior analysis as well as 
common tenets of early childhood education 
(Strain & Hoyson, 2000; Strain, Hoyson, & 
Jamieson, 1985) with a goal of reducing 
children's characteristics of autism that inter¬ 
fere with their learning opportunities. The 
LEAP model uses an inclusive education 
approach whereby children with ASD are 
taught alongside typically developing, same- 
aged peer confederates. Irrespective of class¬ 
room type, all classrooms, including BAU 
classrooms, had to meet a priori determined 
screening criteria to ensure classroom quality. 
Specifically, all classrooms had to meet an 
“average" rating (score of three out of five) on 
four subscales of a validated classroom quality 
measure: the PDA program assessment (Pro¬ 
fessional Development in Autism Center, 
2008) during an initial classroom visit. In 
addition, TEACCH and LEAP classrooms had 
to meet above-average ratings (3.5 out of 5) on 
model-specific subscales and items on their 
respective fidelity of implementation mea¬ 
sures. 

Procedure 

Research staff collected 30-min video¬ 
taped samples for each child participant (i.e., 
focal child) during center time at pretest 
(beginning of the school year) and posttest 
(end of the school year). For the purposes of 
this study, only posttest video samples were 
used. Video lengths ranged from 24 min to 
30 min as a result of unforeseen issues (e.g., 
child leaving the classroom unexpectedly 
during videotaping, issues with videotaping). 
Center time was selected as the observation 
context because it was a common feature 
across all classroom types. Adults, other 
children, or the focal child could select the 
activities the focal child engaged in during this 
time. Classroom activities commonly occurred 
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in such areas as manipulates, dramatic play, 
sensory, pre-academics, computers, large 
blocks, or art. Instructions were provided to 
research staff to video the focal child and the 
environmental context (i.e., film focal child, 
center where focal child was located, and 
other children/adults in center). Filming could 
begin during centers or another activity (e.g., 
transition or circle time), but no more than 
5 min of an activity other than centers could be 
filmed. 

Social behavior was operationally defined 
as any positive gestural/motor or verbal/vocal 
behavior directed toward either a peer or an 
adult. Examples of social behavior included 
talking to a peer/adult, touching an adult or 
peer (e.g., holding hands, hugging), and 
responding to an adult or peer (e.g., answering 
an adult's question or following directions). 
Negative social behavior was operationally 
defined as any negative gestural/motor or 
verbal/vocal behavior directed toward either 
a peer or an adult (e.g., hitting, saying "no"). 
Negative social behaviors were not coded or 
included in this study because of their low 
frequency of occurrence. 

Social behavior was coded using MTS, 
PIR, and event coding. Initially, Procoder 
observational software (Tapp & Walden, 
2000) was used to code all videos using a 
MTS framework. An eco-behavioral coding 
scheme, the Code for Active Student Partici¬ 
pation and Engagement (CASPER), was applied 
across child and adult behaviors as well as 
classroom environmental features to opera¬ 
tionally define all behavioral codes (Tsao, 
Odom, & Brown, 2001). Social behavior was 
coded using a mutually exclusive hierarchical 
coding system for the following social behav¬ 
iors: social behavior directed to an adult, 
negative social behavior directed to an adult, 
social behavior directed to a peer, negative 
social behavior directed to a peer, social 
behavior directed from a peer to the focal 
child, negative social behavior directed from a 
peer to the focal child, no social behavior, and 
cannot tell. In other words, only one category 
of social behavior could be coded at a time 
with those listed first (e.g., social behavior 
directed to an adult) taking precedence if more 
than one social behavior occurred simulta¬ 
neously. Social behavior was coded using MTS 
in 10-s intervals for a total of six possible social 
behaviors per minute. 

Next, each video was coded simulta¬ 
neously using PIR and event coding. For event 


coding, the total number of social behaviors 
directed toward peers and adults were tallied 
separately within each 10-s interval to assist 
with analyzing interobserver agreement (IOA). 
For PIR, social behaviors directed toward both 
peers and adults (separately) were coded as 
either occurrence or nonoccurrence for each 
10-s interval for a total of six possible social 
behaviors per minute. 

Data Analysis 

In order to compare across the three 
coding methods, the total number of social 
behaviors directed to both peers and adults 
obtained for each method were converted to a 
rate per minute. To obtain the rate per minute 
of social behaviors, the total number of social 
behaviors for each coding method (i.e., MTS, 
PIR, and event) was divided by the length of 
videotaped sample. For example, if MTS 
captured 25 social behaviors, PIR 33 social 
behaviors, and event 41 social behaviors 
within a 28-min videotaped sample, the rate 
per minute for each would be an estimation of 
0.89 social behaviors for MTS, an estimation of 
1.18 social behaviors for PIR, and 1.46 social 
behaviors for event coding. Converting each 
frequency to a rate per minute allowed for a 
clear, unbiased comparison of each coding 
method across the classroom type. If frequency 
count was used rather than rate per minute, 
participants who had a full 30-min sample 
would have the opportunity for a greater 
weight in the analysis than a participant with 
only a 24-min sample. Further, in order to 
compare the three coding methods, we needed 
to use the same metric. For this analysis, we 
selected rate versus percentage of intervals 
to allow for a comparison across the three 
different coding methodologies. In order to 
increase the accuracy of using a rate conver¬ 
sion with MTS and PIR, we employed brief, 
10-s intervals. Given the low rates of social 
behavior, it is likely that MTS and PIR 
represent a close approximation to actual 
behavior rates. Previous research findings 
indicate that the use of shorter intervals with 
MTS and PIR will result in a more accurate 
representation of behavior (Ary & Suen, 1 983; 
Powell et al., 1975). 

Pearson's correlations were used to deter¬ 
mine the association between the coding 
methods. The strength of relationships were 
based on the following: r values between 0 
and 0.3 indicated weak positive relationships, 
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TABLE 1 

IOA across Models for Social Behavior Directed toward Adults and Peers 



Momentary 

Interval 

Event 

kappa 

A/(A + D) 

kappa 

A/(A + D) 

kappa 

A/(A + D) 

Toward adults 

0.68 

0.98 

0.96 

0.94 

0.93 

0.91 


(0.21-1) 

(0.95-1) 

(0.85-1) 

(0.81-1) 

(0.83-1) 

(0.83-1) 

Toward peers 

0.84 

0.99 

0.97 

0.96 

0.97 

0.94 


(0.33-1) 

(0.98-1) 

(0.74-1) 

(0.75-1) 

(0.83-1) 

(0.75-1) 


Note. A = agreement of occurrence, D = disagreement of nonoccurrence. 


rvalues between 0.3 to 0.7 indicated moder¬ 
ate positive relationships, and r values be¬ 
tween 0.7 and 1.0 indicated strong positive 
relationships (Ratner, 2009). To examine the 
differences of rate of social behavior per 
minute across models, ANOVAs were used. 
Eta-squared values are also reported. An eta- 
squared criterion of 0.09 is a medium effect 
size for the social sciences (Pierce, Block, & 
Aguinis, 2004). For all significant differences, 
post hoc tests using Tukey's honest significant 
difference were run to determine specific 
model differences. 

Results 

Two graduate-level research assistants 
were trained on the coding methods. Training 
initially included familiarization with the 
CASPER-III Training Manual for Observers 
(Tsao et al., 2001). For MTS, analysis and 
discussion followed practiced observations 
until trainers reached 80% agreement (i.e., 
the number of agreements divided by the 
number of agreements and disagreements) 


and a kappa of at least 0.80 for each variable. 
A similar training occurred for using PIR and 
event coding. Kappa was determined using 
Procoder observational software (Tapp & 
Walden, 2000). Procoder was not used to 
determine agreement for PIR or event coding 
because Procoder counted agreements of no 
social behavior into calculations. To obtain a 
more accurate IOA, agreement for PIR and 
event coding was calculated in an Excel 
spreadsheet using the following formula: 
agreement/(agreement + disagreement). Twen¬ 
ty percent of videos were coded by both 
coders to examine the IOA. See Table 7 for 
IOA for each of the three coding methods. For 
event coding, IOA was calculated by occur¬ 
rence of agreements within 10-s intervals. 
Therefore, if one observer coded two events 
in one interval and the other coded one, the 
observers had one agreement and one dis¬ 
agreement. The observers had the highest 
agreement (0.99) when coding social behavior 
toward peers using MTS. The observers had the 
least agreement (0.91) when using event 
coding to code social behavior toward adults. 



Figure 1. Social behavior. 
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TABLE 2 

Pearson's Correlation for Social Behavior Directed toward Adults 


Momentary Interval Event 



Peer 

Adult 

Peer 

Adult 

Peer 

Adult 

Momentary 

1.00 

1.00 

0.882 a 

0.732 a 

0.890“ 

0.738“ 

Interval 



1.00 

1.00 

0.991“ 

0.963“ 

Event 





1.00 

1.00 


a Strong positive linear correlation at the 0.001 level. 

Social Behavior toward Adults 

Event coding resulted in the highest 
number of social behaviors directed toward 
an adult with a mean of 1.77 (range 0.13-6.1 7) 
social behaviors directed toward adults per 
minute (m = 53.03 total social behaviors in 
30-min segment). PIR estimated 1.29 social 
behaviors (range 0.13-3.45) per minute (m = 
38.66 total estimation of social behaviors in 
30-min segment), followed by MTS with 0.34 
(range 0-1.87) estimated social behaviors per 
minute (m = 10.23 total estimation of social 
behaviors in 30-min segment; see Figure 7). 
All methods were strongly correlated with an r 
value greater than 0.7 (see Table 2). Compar¬ 
ing all three coding methods, PIR to event had 
the strongest correlation with an r of 0.963 (p 
< .001). MTS and PIR had the weakest 
correlation of r — 0.732 (p < .001). However, 
this rvalue indicated a strong correlation using 
Ratner's guidelines (2009). 

Social Behavior toward Peers 

Figure 7 displays the social behavior of 
focal children toward peers. Similar to social 


behavior toward adults, event coding resulted 
in the most social behaviors toward peers per 
minute with a rate of 0.45 (range 0-4.03; m = 
13.49 total social behaviors in 30-min seg¬ 
ment). This was followed by PIR (rate = 0.34 
estimated social behaviors per minute, range 
0-2.7; m = 10.29 total estimation of social 
behaviors in 30-min segment) and MTS (rate = 
0.13 estimated social behaviors per minute, 
range 0-1.14; m = 3.82 total estimated social 
behaviors in 30-min segment). All correlations 
between the various coding methods were 
significant. The strongest correlation was 
between event and PIR (r = 0.991 , P < 
.001), followed by MTS and event (r = 
0.890, p < .001) and MTS and PIR (r = 
0.882, p < .001) (see Table 2). 

Observational Methods and Classroom 
Types 

Social Behavior towards Adults 

Figure 2 displays the social behavior 
directed toward adults of focal children across 
the three models. Across the three models, 
children in LEAP classrooms exhibited higher 



Figure 2. Social behavior directed toward adults across models. 
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Momentary Interval Event 

Coding Method 


□ BAU (n=34) 

□ LEAP (n=33) 

□ TEACCH (n=33) 


Figure 3. Social behavior directed towards peers across models. 


rates of social behavior directed toward adults 
followed by students in TEACCH classrooms 
and then BAU classrooms. Analyses of vari¬ 
ance were performed to determine if differ¬ 
ences in social behavior existed between 
classroom programs (i.e., TEACCH, LEAP, 
and BAU) for each of the methods. No 
significant differences in social behavior di¬ 
rected toward adults were found. 

Social Behavior towards Peers 

The social behavior directed toward peers 
across the three models is depicted in 
Figure 3. Based upon the ANOVAs, all three 
coding methods resulted in significant group 
differences in social behavior directed toward 
peers. Further, a similar pattern emerged 
across the coding methods. Social behavior 
directed toward peers differed significantly (p 
— .008 and rp = 0.10) when using MTS. 
Children in TEACCH classrooms were less 
likely (p = .006) to display social behaviors 
toward peers than children in BAU class¬ 
rooms. For PIR, social behavior directed 
toward peers again differed significantly (p 
= .001 and r\ 2 = 0.130) with children in 
TEACCH classrooms displaying less social 
behavior than children in BAU (p = .001) 
or LEAP (p =.018) classrooms. Event coding 
also showed statistically significant differenc¬ 
es between models (p = .002 and rf = 0.120) 
with children in TEACCH classrooms less 
likely to display social behaviors toward peers 
than children in BAU (p = .020) or LEAP (p = 
.028) classrooms. 


Discussion 

Confirming findings from previous re¬ 
search studies (Brown, Odom, Li, & Zercher, 
1999; Reszka et al., 2012; Tsao et al., 2008), 
social behaviors as assessed by all three coding 
methods for children with ASD were quite 
low. Mean social behaviors toward adults 
ranged from 0.34 to 1.77 behaviors per 
minute, depending on the coding method, 
and social behaviors toward peers ranged from 
0.13 to 0.45 per minute. The findings indicated 
a strong relationship among MTS, PIR, and 
event coding for social behaviors directed 
toward both adults and peers. The relationship 
was strongest between PIR and event coding 
for social behaviors directed toward adults and 
peers. Further, the relationship among the 
coding methods was strongest for very low- 
occurring behaviors (i.e., social behavior 
directed toward peers). Additionally, there 
was more variability between MTS and event 
coding as well as MTS and PIR. The variability 
was more evident as the frequency of social 
behaviors increased. In general, it appears that 
more social behaviors were more accurately 
coded when event coding and PIR methods 
were used compared with MTS. 

In regards to the patterns of social behav¬ 
iors for each coding method across classroom 
programs, results showed that a similar pattern 
emerged across the coding methods. While no 
statistical differences among CTMs were found 
for social behavior directed toward adults, 
visual inspection indicated a similar pattern. 
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For all three coding methods, the most social 
behaviors directed toward adults occurred in 
LEAP classrooms followed by TEACCH and 
then BAU classrooms. The lack of significant 
differences for social behavior directed toward 
adults is perhaps not surprising given that no 
group differences were found in the larger 
study (see Boyd et al., 2014). One of the 
reasons could be that teachers in LEAP, 
TEACCH, and BAU classrooms were using 
similar instructional strategies, such as visual 
supports, to educate and interact with children 
with ASD (Boyd et al., 2014). 

Additionally, the coding methods pro¬ 
duced similar patterns across models for social 
behavior directed toward peers. For PIR and 
event coding, significant differences were 
found among classroom types, with children 
in TEACCH classrooms less likely to display 
social behaviors toward peers than children in 
BAU and LEAP classrooms. Momentary time 
sampling only found statistically significant 
differences among children in TEACCH class¬ 
rooms and children in BAU classrooms. 
However, visual inspection shows that chil¬ 
dren in TEACCH classrooms were less likely to 
demonstrate social behaviors toward peers 
than children in LEAP classrooms. Given that 
TEACCH classrooms were primarily comprised 
of children with ASD, fewer opportunities for 
peer social interactions might have been 
possible because a majority of the children 
likely had social deficits. 

Overall, we found that the three coding 
methods produced similar patterns when used 
in different classroom types. The strong corre¬ 
lations found when examining social behavior 
toward adults and peers indicate that all three 
coding methods are viable options for captur¬ 
ing low-occurring social behaviors in young 
children with ASD. However, given the lower 
estimates for the occurrences of social behav¬ 
ior when using MTS, researchers should use 
caution when employing these methods and 
ensure the coding methodology accurately 
captures low-occurring behaviors. 

Limitations 

Several limitations need to be considered 
and addressed. First, videotaped observations 
are somewhat problematic. This method of 
coding may be especially limiting when using 
event coding or MTS. Children may be 
temporarily out of view, or the video may not 
show the social partner of the child. These 


errors in video recording can impact the 
number of behaviors observed. Additionally, 
recording individuals in a classroom may 
impact how adults and children interact. 

This sample included only data from one 
time point, so no inferences can be made 
about the stability of social behavior over time 
or whether any group differences are main¬ 
tained throughout the school year. Additional¬ 
ly, coders used the CASPER code hierarchy of 
social behaviors when employing MTS meth¬ 
odology; therefore, at each interval, partici¬ 
pants could only be coded as directing social 
behavior toward an adult or peer. This allowed 
for the possibility of social behavior directed 
toward peers to not be captured. PIR and event 
coding allowed for simultaneous coding of 
both social behavior directed toward peers and 
adults. The three coding methodologies might 
have had a stronger relationship if the CASPER 
code allowed for simultaneous social behav¬ 
ior. Also, comparing the three coding methods 
and converting frequency data to rate data has 
been shown to be problematic (Repp et al., 
1976; Yoder & Symons, 2010). However, due 
to the various lengths of videotaped samples, 
data needed to be converted into a rate per 
minute in order to have a common dependent 
variable for comparison. 

Further, this study does not address other 
behavioral assessment approaches that assess 
duration and sequential associations between 
behaviors but only examines behaviors with¬ 
out considering the context before or after a 
given behavior. Finally, the sample size is 
small, and perhaps different conclusions could 
be drawn if a larger sample size was used. 
However, this study is the first exploration 
comparing various observational coding meth¬ 
ods for observing low-occurring social behav¬ 
iors in children with autism. 

Implications 

These findings are intended to inform both 
researchers and practitioners as they carefully 
consider the selection and usage of behavior 
observation methods, specifically when cod¬ 
ing low-incidence behaviors, such as social 
interaction between young children on the 
autism spectrum. Overall, the results confirm 
past research that MTS underrepresents low- 
frequency behaviors when compared to event 
coding (Odom & Ogawa, 1992). However, the 
strong relationship among the various coding 
methods suggests that using MTS as an 
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approximation for low-occurring social behav¬ 
iors is still a useful approach, in particular 
when reliability or costs prohibit other coding 
approaches. Further, if the research question 
addresses differences between conditions (e.g., 
focusing interventions like a peer-mediated 
approach versus a control condition or two 
comprehensive treatment models versus a 
control condition), it appears that MTS may 
be as sensitive to treatment conditions as is 
event coding or PIR. When costs and reliability 
issues are not a factor, use of PIR and event 
coding would result in the best reflection of 
actual behavior occurrence. 

These findings may allow researchers and 
practitioners to weigh other potential benefits 
of sampling procedures in their decision 
making, such as reduced observer drift and 
fatigue, increased feasibility and likelihood of 
use by practitioners, and increased ease in 
obtaining and maintaining observer reliability. 
Although the literature is replete with articles 
and chapters that describe and use various 
observational methods (Harrop & Daniels, 
1986; Harrop et al., 1990; Odom & Ogawa, 
1992; Powell et al., 1975), few have empiri¬ 
cally examined the association across proce¬ 
dures, and/or the relationships among them. 
These variables can and should contribute to 
decisions around the selection of direct be¬ 
havioral assessment techniques. 
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